Second task execution assistance device and non-transitory computer readable storage medium

ABSTRACT

An execution of a second task of a driver is assisted in cooperation with a user interface in an autonomous driving state in which a vehicle is an execution entity of a driving task. The second task is extracted, which is properly executable within task possible time estimated as time in which the second task is executable in a route to a destination of the vehicle. The second task extracted by the second task extracting unit is suggested through the user interface.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of InternationalPatent Application No. PCT/JP2020/022629 filed on Jun. 9, 2020, whichdesignated the U.S. and claims the benefit of priority from JapanesePatent Application No. 2019-139116 filed on Jul. 29, 2019. The entiredisclosures of all of the above applications are incorporated herein byreference.

TECHNICAL FIELD

The present disclosure relates to a second task execution assistancedevice and a non-transitory tangible computer readable storage medium.

BACKGROUND

A conceivable technique teaches a path search device for retrieving apath reaching a destination by the time content based on a watch requestis watched until the end.

SUMMARY

According to an example, an execution of a second task of a driver isassisted in cooperation with a user interface in an autonomous drivingstate in which a vehicle is an execution entity of a driving task. Thesecond task is extracted, which is properly executable within taskpossible time estimated as time in which the second task is executablein a route to a destination of the vehicle. The second task extracted bythe second task extracting unit is suggested through the user interface.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects, features and advantages of the presentdisclosure will become more apparent from the following detaileddescription made with reference to the accompanying drawings. In thedrawings:

FIG. 1 is a diagram illustrating an entire image of an in-vehiclenetwork including an HCU of a first embodiment;

FIG. 2 is a diagram illustrating a schematic configuration of the HCU ofthe first embodiment;

FIG. 3 is a diagram schematically illustrating task possible time andcontent in a route to a destination in the first embodiment;

FIG. 4 is a diagram illustrating a route plan suggestion screen in thefirst embodiment;

FIG. 5 is a diagram illustrating a second task suggestion screen in thefirst embodiment;

FIG. 6 is a flowchart illustrating processes by the HCU of the firstembodiment;

FIG. 7 is a flowchart illustrating processes by the HCU of the firstembodiment;

FIG. 8 is a diagram illustrating a route plan and a second tasksuggestion screen in a second embodiment;

FIG. 9 is a flowchart illustrating processes by an HCU of the secondembodiment;

FIG. 10 is a diagram schematically illustrating task possible time andcontent in a route to a destination in a third embodiment; and

FIG. 11 is a flowchart illustrating processes by an HCU of the thirdembodiment.

DETAILED DESCRIPTION

In recent years, a vehicle having an autonomous driving function inwhich the vehicle becomes an execution entity of a driving task is beingrapidly spread. In such a vehicle, there is a case that execution of asecond task by the driver in an autonomous driving state is permitted.In the device of the conceivable technique, however, since content basedon a watch request is continuously reproduced until the end in a routeto a destination, in some cases, it is unpreferable for the driver toenjoy it as a second task.

In the autonomous driving state, by selecting and executing a propersecond task, the driver can enjoy the second task more. However, since adriver cannot easily know a condition that a second task can beexecuted, it is difficult for the driver to select a proper second taskby himself/herself. Therefore, it is demanded to assist so that a drivercan select a proper second task and execute it.

A second task execution assistance device and a non-transitory tangiblecomputer readable storage medium for enabling a second task proper to adriver to be easily selected and executed.

One of modes disclosed here is a second task execution assistance deviceassisting execution of a second task of a driver in an autonomousdriving state in which a vehicle is an execution entity of a drivingtask, in cooperation with a user interface, including:

a second task extracting unit extracting the second task which can beexecuted properly within task possible time predicted as time in whichthe second task can be executed in a route to a destination of thevehicle; and

a second task suggesting unit suggesting the second task extracted bythe second task extracting unit through the user interface.

Another one of the disclosed modes is a second task execution assistanceprogram assisting execution of a second task of a driver in anautonomous driving state in which a vehicle is an execution entity of adriving task, in cooperation with a user interface,

wherein at least one processing unit is made execute:

a process of extracting the second task which can be executed properlywithin task possible time predicted as time in which the second task canbe executed in a route to a destination of the vehicle; and

a process of suggesting the extracted second task via the userinterface.

According to those modes, a second task suggested to a driver throughthe user interface is a second task which can be executed properlywithin task possible time predicted as time in which a second task canbe executed. Since a second task appropriate to task possible time issuggested, even when it is difficult for a driver himself/herself toaccurately understand and predict a condition under which a second taskcan be executed and task possible time corresponding to the condition,the driver can easily select a proper second task. By selecting andexecuting a second task optimized in time, the driver can effectivelyuse time in a route to a destination.

Hereinafter, a plurality of embodiments will be described with referenceto the drawings. In some cases, by assigning the same reference numeralto corresponding components in each of the embodiments, repetitivedescription is omitted. In the case where only a part of a configurationis described in each of the embodiments, with respect to another part ofthe configuration, the configuration of another embodiment describedantecedently can be applied. The present embodiments are not limitedonly to combinations of configurations demonstrated in description ofthe embodiments. When no hindrance occurs in a combination, even it isnot demonstrated, the configurations of the plurality of embodiments canbe partly combined.

First Embodiment

As illustrated in FIG. 1, a display control device according to a firstembodiment of the present disclosure is an HCU (Human Machine Interface)100. The HCU 100 forms an information presentation system in cooperationwith an information presentation device 31 and the like. The HCU 100 isan electronic control device controlling the information presentationdevice 31 and realizing compositely an information presentationfunction, a second task execution assistance function, and the like. TheHCU 100 is used in a vehicle 1 and, for example, is mounted in thevehicle 1. The HCU 100 is communicably connected to a communication bus99 of an in-vehicle network mounted in the vehicle 1. The HCU 100 is oneof a plurality of nodes provided for the in-vehicle network. To thecommunication bus 99 of the in-vehicle network, for example, anoperation device 21, a DCM (Data Communication Module) 41, a locator 42,a surround monitoring sensor 43, a vehicle control actuator 44, and anautonomous driving electric control unit (ECU) 51 are connected asnodes.

The operation device 21 is an intension input unit receiving a useroperation by an occupant such as a driver. The operation device 21includes a driving operation device 22 such as a steering wheel, anaccelerator pedal, a brake pedal, and the like for executing a drivingoperation. When a user operation is performed for the driving operationdevice 22, information of the user operation is provided to theautonomous driving ECU 51 and the like.

The operation device 21 includes a non-driving-operation device 23. Thenon-driving-operation device 23 performs switching of start and stop andsetting change with respect to an autonomous driving function, acooling/heating function, a function of setting a route to adestination, a second task execution assistance function, and the like.As the non-driving-operation device 23 for executing the useroperations, for example, a steer switch provided for a spoke unit of asteering wheel, an operation lever provided for a steering column unit,a touch panel provided integrally with a display 32 of the informationpresentation device 31, a gesture operation device detecting a gestureas a user operation using a shooting module such as a driver statusmonitor, and the like can be mentioned. When a user operation isexecuted for the non-driving-operation device 23, information of theuser operation is provided for the autonomous driving ECU 51, the HCU100, and the like. The operation device 21 forms a user interface 20 ofthe vehicle 1 in cooperation with the information presentation device 31and the like.

The DCM 41 is a communication module mounted in the vehicle 1. The DCM41 transmits/receives electric waves to/from the vehicle 1 and a basestation in the periphery by wireless communication conformed to thecommunication standard such as LTE (Long Term Evolution), 5G, or thelike. By mounting the DCM 41, the vehicle 1 becomes a connected carwhich is connected to the Internet. The DCM 41 obtains various data froma probe server provided in the cloud. The various data includes latestmap data of the road on which the vehicle 1 travels, data of trafficinformation (for example, present traffic amount, predicted trafficamount, and road situations such as traffic rule by a construction),data of weather information (for example, present weather and predictedweather), reproduction data of content to be reproduced in theinformation presentation device 31, and the like.

The locator 42 generates high-precision position information of thevehicle 1 by composite positioning of combining a plurality of pieces ofacquisition information. The locator 42 can specify, for example, a lanein which the vehicle 1 travels in a plurality of lanes. The locator 42includes a GNSS receiver receiving positioning signals transmitted froma plurality of artificial satellites, an inertial sensor, a map databasein which the above-described map data is stored, and a locator ECUgenerating position information of the vehicle 1 by combining dataobtained from those units.

The surround monitoring sensor 43 is an autonomous sensor monitoring thesurrounding environment of the vehicle 1. The surround monitoring sensor43 can detect, from the detection range of the periphery of the vehicle1, a moving object such as a pedestrian, a cyclist, an animal other thana human, another vehicle, and the like, a stationary object such as afallen object on the road, a guardrail, a curbstone, a road sign, apavement mark such as a driving compartment line, and a construction bythe roadside, and the like. The surround monitoring sensor 43 providesdetection information obtained by detecting an object around the vehicle1 to the autonomous driving ECU 51, the HCU 100, and the like via thecommunication bus 99.

The surround monitoring sensor 43 has a front camera and amillimeter-wave radar as detection components for detecting an object.The front camera outputs, as detection information, at least one ofimage data obtained by shooting the front range of the vehicle 1 and aresult of analyzing the image data. A plurality of millimeter-waveradars are disposed, for example, in front and rear bumpers of thevehicle 1 at intervals. The millimeter-wave radar emits millimeter wavesor quasi-millimeter waves to the front range, the front side range, therear range, the rear side range, and the like of the vehicle 1. Themillimeter-wave radar generates detection information by a process ofreceiving a reflection wave reflected by a moving object, a stationaryobject, or the like. A detection configuration of a lidar, a sonar, orthe like may be included in the surround monitoring sensor 43.

The vehicle control actuator 44 has a configuration including a vehiclesteering device, a vehicle driving device, and a vehicle braking devicefor executing a driving operation. The driving operation includesvehicle steering, vehicle driving, and vehicle braking. The vehiclesteering device is a device of controlling a steering angle given to,for example, the front wheels of the vehicle 1. The vehicle drivingdevice is a device of driving, for example, the front wheels of thevehicle 1 by using power provided from the power source of the vehicle1. The vehicle braking device is a device of braking, for example, thefront wheels of the vehicle 1 by a braking method such as frictionbraking, regenerative braking, or the like.

The autonomous driving ECU 51 is an electronic control unit realizingcompositely an autonomous driving function, an advanced driver assistfunction, and the like. The autonomous driving ECU 51 forms a vehiclecontrol system in cooperation with the HCU 100 and the like. Theautonomous driving ECU 51 can recognize the peripheral environment ofthe vehicle 1 on the basis of detection information obtained from thesurround monitoring sensor 43. The autonomous driving ECU 51 also cancontrol the vehicle control actuator 44. By mounting the autonomousdriving ECU 51, the vehicle 1 can perform at least a part of the drivingtask for the driver. The driving task includes driving operation andmonitoring of the surroundings. With the configuration, the vehicle 1 ofthe embodiment can perform the automation driving of Level 3 in theautomation driving levels defined by the society of automotive engineersof the United States.

The autonomous driving ECU 51 has a configuration including, mainly, acomputer having a processor, a RAM (Random Access Memory), a storageunit, an input/output interface, a bus which connects those components,and the like. The autonomous driving ECU 51 has a plurality of functionunits realizing autonomous driving and advanced driver assist byexecuting a program stored in the storage unit by the processor.Concretely, as illustrated in FIG. 2, the autonomous driving ECU 51 hasan autonomous driving state managing unit 52 and a route planning unit53.

The autonomous driving state managing unit 52 manages the state ofautonomous driving on the basis of position information of the vehicle 1obtained from the locator 42, detection information obtained from thesurround monitoring sensor 43, traffic information and weatherinformation obtained through the DCM 41, further, setting information ofthe autonomous driving function by the non-driving-operation device 23,information of a user operation which is input to the driving operationdevice 22, and the like. Particularly, in the embodiment, the autonomousdriving state managing unit 52 manages the automation driving level as avehicle control state and properly switches. In the embodiment, theautomation driving level takes a discrete numerical value as an integerwhich is equal to or larger than 0 and is equal to or less than three.It means that the higher the numerical value of the automation drivinglevel becomes, the larger the range of the authority to execute adriving task of the autonomous driving ECU 51 (substantially the vehicle1) becomes. The automation driving level switched by the autonomousdriving state managing unit 52 is conformed to the automation drivinglevel defined by the society of automotive engineers in the UnitedStates.

For example, in the case where the automation driving level is Level 0,the driver becomes an execution entity for all of the driving tasks. Inthe case where the automation driving level is Level 1, the executionentity of either vehicle steering or vehicle driving and vehicle brakingin the driving tasks is the vehicle 1, and the execution entity of allof the other driving tasks becomes the driver. In the case where theautomation driving level is Level 2, the execution entity of the drivingoperation of the vehicle steering, the vehicle driving, and the vehiclebraking becomes the vehicle 1. The driver becomes the execution entityof the surrounding monitoring and monitors the execution state of thedriving operation by the vehicle 1 and has to maintain a state where thedriving operation device 22 can be immediately operated by, for example,gripping the steering wheel so that the driver can always intervene thedriving operation.

In the case where the automation driving level is Level 3, the executionentity of all of the driving tasks of vehicle steering, vehicle driving,vehicle braking, and surrounding monitoring becomes the vehicle 1, andthe autonomous driving ECU 51 on the vehicle 1 side executes thosedriving tasks. At this time, the driver can perform a second taskwithout monitoring the execution state of the driving tasks by theautonomous driving ECU 51.

The second task is a secondary task indicating a task other than thedriving in the case where the driving task is set as a primary task, andis also called a secondary task, a secondary activity, or otheractivities. The second task is a concept including various tasks such aswatching of content, computer game, browsing and transmitting work of ane-mail, browsing of a website, operation of a cellular phone orsmartphone, eating, making-up, and reading.

The autonomous driving state managing unit 52 properly switches theautonomous driving level. In the case where the automation driving levelis Level 0, the autonomous driving ECU 51 obtains information of a useroperation of the driving operation device 22 and controls the vehiclecontrol actuator 44 so that the vehicle control actuator 44 operateswith an operation amount and an operation timing faithful to the useroperation. In the case where the automation driving level is Level 3,the autonomous driving ECU 51 calculates the operation of the vehiclecontrol actuator 44 for making the vehicle 1 travel along a travelscheduled line planned by the route planning unit 53, and controls thevehicle control actuator 44 so as to realize the calculated operation.In the case where the automation driving level is Level 1 or 2, acontrol which is intermediate between the control at Level 0 and thecontrol at Level 3 is executed.

When the vehicle 1 travels in an autonomous driving possible section inwhich the autonomous driving can be performed, the autonomous drivingstate managing unit 52 sets the upper limit of the automation drivinglevel to Level 3 and sets the autonomous driving level according tovarious conditions. On the contrary, when the vehicle 1 travels in anautomation driving impossible section and an automation drivingrestricted section in which the autonomous driving is restricted, theautonomous driving state managing unit 52 sets the upper limit of theautomation driving level to Level 2 or lower.

The autonomous driving possible section and the autonomous drivingrestricted section are distinguished, in a case, by the road traffic lawand ordinances of the country and the area in which the vehicle 1travels and, in another case, distinguished on the basis of technicalrestrictions caused by the infrastructure construction state, the roadshape, and the like of the road on which the vehicle 1 travels. Forexample, there is a case that an expressway corresponds to theautonomous driving possible section, and an ordinary road corresponds tothe autonomous driving restricted section. The distinction of theautonomous driving possible section and the autonomous drivingrestricted section is, for example, associated with the above-describedmap data and stored as information in the map database in a storingmedium.

Even when the vehicle 1 is travelling in the autonomous driving possiblesection, there is a case that the autonomous driving state managing unit52 lowers the autonomous driving level to Level 2 or lower. For example,in the case where the autonomous driving function reaches a functionlimit or the reach to the function limit is predicted, the autonomousdriving state managing unit 52 lowers the autonomous driving level toLevel 2 or lower suddenly. As the reach to the function limit,occurrence of an event the autonomous driving ECU 51 does not expect inthe surrounding environment, difficulty to continue operation of theautonomous driving function caused by a functional failure or the likeof the surround monitoring sensor 43 due to bad weather, and the likecan be mentioned. For example, the autonomous driving state managingunit 52 lowers the automation driving level to Level 2 or lower inaccordance with an operation of changing the setting of the autonomousdriving function by the driver.

In the embodiment, as an additional condition to set the automationdriving level to Level 3 in the autonomous driving possible section, acondition that the speed of the vehicle 1 is less than a predeterminedpermissible speed (for example, 30 km/h) is given and, for example, asecond task can be executed at the time of low-speed travel duringtraffic jams. On the contrary, in the case where the vehicle 1 isdemanded to travel so that the speed of the vehicle 1 becomes equal toor higher than a predetermined permissible speed along the flow oftraffic, the automation driving level is set normally to, for example,Level 2 also in the autonomous driving possible section. Further, thereis a case that the automation driving level is suddenly lowered to Level1 or lower as described above.

The route planning unit 53 plans a route of the vehicle 1 to thedestination which is set by a user operation of the driver. The routeplanned by the route planning unit 53 includes a schematic route and adetailed route in a road on which the vehicle 1 is travelling atpresent. The schematic route is planned mainly before departure. Theschematic route includes a path to the destination of the vehicle 1,departure time and prediction arrival time which is predicted, further,prediction driving time since the departure time to the predictionarrival time, prediction autonomous driving time which is predicted astime in which automation driving of Level 2 or higher can be performed,and the like. The prediction driving time can be schematicallycalculated on the basis of a way in the path obtained from the map data,information of speed limit of each of roads in the path, and trafficinformation and weather information. The prediction autonomous drivingtime can be calculated as prediction time required to pass theautonomous driving possible section in the driving time.

With respect to the schematic route, the route planning unit 53schematically specifies roads on which the vehicle 1 travels to reachthe destination as a path to the destination of the vehicle 1. One pathor a plurality of paths may be specified. When the present time isbefore departure of the route, the route planning unit 53 calculatesoptimum departure time in consideration of traffic information andweather information for the specified path. The optimum departure timeis not limited to one but, in many cases, a plurality of optimumdeparture times are calculated. The optimum departure time includesdeparture time for the earliest prediction arrival time, departure timewhich maximizes the ratio of the prediction autonomous driving time inprediction driving time since departure time to arrival time, departuretime which minimizes the prediction driving time, departure time whichoptimizes the balance between the ratio of the prediction autonomousdriving time and the length of the prediction driving time, departuretime by which the time zone of the prediction autonomous driving time orthe time zone of Level 3 is not easily divided into pieces, and thelike.

For route plans corresponding to a plurality of optimum departure timeson a one-by-one basis, the same path may be set or different paths maybe set. The plurality of routes derived in such a manner are narroweddown to one route through intention confirmation using the HCU 100 whichwill be described specifically later and the user interface 20. Based onthe one route plan which is narrowed down, the control of the vehiclecontrol actuator 44, that is, execution of the driving task according tothe automation driving level which is set by the autonomous drivingstate managing unit 52 is performed.

The detailed route includes a scheduled travel line of the vehicle 1, aspeed plan of the vehicle 1, and the like. The detailed route is set foreach road on which the vehicle 1 is travelling at present at the time ofoperation of the autonomous driving function and corrected according tothe surrounding environment. The route planning unit 53 specifies, as ascheduled travel line, a lane on which the vehicle 1 travels among aplurality of lanes on the road on which the vehicle 1 is travelling atpresent, a trajectory of a lane change in the case where the vehicle 1changes the lane, and the like. The scheduled travel line of the vehicle1 is specified on the basis of detection information from the surroundmonitoring sensor 43, position information from the locator 42, and thelike. With the specification of the scheduled travel line, the routeplanning unit 53 specifies a detailed speed plan such as accelerationand deceleration at the time of travelling on the scheduled travel line.

Next, the details of each of the information presentation device 31 andthe HCU 100 included in the information presentation system will bedescribed in order.

The information presentation device 31 is a device presentinginformation to the driver. As illustrated in FIG. 1, the informationpresentation device 31 has a configuration including the display 32 anda speaker 33. The display 32 is mounted, for example, in an instrumentpanel. The display 32 is a configuration having, as a main body, adisplay group including elements such as a graphic meter, a head updisplay (HUD), and a center information display (CID). The display 32can display an image in a screen 32 a.

The speaker 33 is disposed, for example, near the screen 32 a of thedisplay 32 in the instrument panel, a door panel, a rear quarter panel,and the like. The speaker 33 can make sound by converting an inputelectric signal to a physical signal by using a voice coil and adiaphragm. One or plural speakers 33 may be provided commonly to thewhole display or may be provided so as to be paired with each of theelements constructing the display 32.

The HCU 100 is an electronic control unit integratedly controllinginformation presentation to an occupant such as a driver in cooperationwith the autonomous driving ECU 51 and the user interface 20. The HCU100 has a configuration including, as a main body, a computer having aprocessing unit 11, a RAM 12, a storing unit 13, an input/outputinterface 14, a bus connecting those components, and the like. Theprocessing unit 11 is hardware for computing process coupled to the RAM12. The processing unit 11 has a configuration including at least onecomputation core such as a CPU (Central Processing Unit) and a GPU(Graphic Processing Unit). The processing unit 11 may further include anIP core having an FPGA (Field-Programmable Gate Array) and anotherdedicated function, and the like. The RAM 12 may include a video RAM forgenerating a video image. By accessing the RAM 12, the processing unit11 executes various processes for realizing functions of function unitswhich will be described later. The storing unit 13 includes, forexample, a non-volatile storing medium such as a semiconductor memory.In the storing unit 13, various programs (for example, a second taskexecution assistance program) to be executed by the processing unit 11,a second task database (hereinbelow, a second task DB) 61, and the likeare stored.

The second task DB 61 illustrated in FIG. 2 is a database constructed byassociating a list of various kinds of second tasks and task requiredtime as time required for each of the second tasks. The list of secondtasks includes a list of content to be watched. The content includes,for example, a movie, a TV program (including a recorded one), a movingpicture distributed by the internet, and multi-media content such as anaudio book. In the list of content, content recorded in the storing unit13 and/or downloadable content by, for example, streaming, progressivedownload, batch download, or the like from an external server via theDCM 41 are written.

The list of second tasks may include not only the list of content butalso a list of second tasks which can be executed by the driver such asa work of browsing and transmitting an e-mail, meals, and the like.

Preferably, the second task DB 61 is configured so that a second task inthe list and information of the characteristic of the second task arealso associated. As the characteristic of a second task, a variationcharacteristic of task required time, an interruption handlingcharacteristic indicating that an interruption easily occurs or not, andthe like can be mentioned. The characteristics of second tasks include acharacteristic of content to be watched. The characteristics of contentto be watched include a category of content such as action, horror,variety, and sports, performers of content, and the like.

The HCU 100 has a plurality of function units by executing a programstored in the storing unit 13 by the processing unit 11. Concretely, theHCU 100 has a route grasping unit 62, a second task extracting unit 63,an information presentation generating unit 64, an operation informationacquiring unit 65, and a content control unit 66.

The route grasping unit 62 grasps the route to the destination of thevehicle 1. In the embodiment, since the route planning unit 53 of theautonomous driving ECU 51 generates a route plan, the route graspingunit 62 can grasp the route by obtaining information of the route plangenerated by the autonomous driving ECU 51. Therefore, the routegrasping unit 62 of the embodiment functions as a route informationacquiring unit. The information of the route grasped by the routegrasping unit 62 is provided to the second task extracting unit 63 andthe information presentation generating unit 64.

The second task extracting unit 63 extracts a second task which can beproperly executed within task possible time which is predicted as timein which a second task can be executed in the route plan grasped by theroute grasping unit 62. The second task which can be executed properlymeans a second task which effectively uses most of the task possibletime and can be finished within the task possible time. Most of the taskpossible time is, for example, 90% or more of the task possible time butmay have a critical value such as 80% or more. The critical value ispreliminarily set to, for example, a range equal to or more than 75% andless than 100%.

The second task extracting unit 63 has a time grasping function, asecond task retrieving function, and an interruption risk graspingfunction. The time grasping function is a function of grasping taskpossible time. The second task extracting unit 63 grasps it bycalculating the time in which the second task can be executed in theprediction autonomous driving time. In the embodiment, setting of Level3 of the automation driving level at which a second task can be executedin the prediction autonomous driving time corresponding to Level 2 ofthe automation driving level is specified when the speed of the vehicle1 is less than permissible speed. Therefore, the second task extractingunit 63 calculates, as task possible time, time expected that thevehicle 1 travels at speed less than the permissible speed in theprediction autonomous driving time predicted to be required to travelthe autonomous driving possible section from the information of aschematic route plan made by the route planning unit 53.

The task possible time is predicted in consideration of at least one ofthe traffic information and the weather information. As illustrated inFIG. 3, there is the possibility that the task possible time becomes atime zone TZ in a lump in a route or is divided in a plurality of shorttime zones TZ1 and TZ2.

The second task extracting unit 63 properly recalculates time in which asecond task can be executed in accordance with a change in the trafficstate and a change in the weather state also during the route to thedestination after departure of the vehicle 1. A result of recalculationis used for a process by the content control unit 66.

The second task retrieving function is a function of retrieving a secondtask. The second task extracting unit 63 accesses the second task DB 61and retrieves an optimum second task from a number of second tasksregistered in the second task DB 61. Concretely, the second taskextracting unit 63 retrieves a second task whose task required time isequal to or shorter than the task possible time and having a differenceless than a predetermined error time (specifically, the difference basedon the above-described critical value). Even when a second task isretrieved based on the task required time and the number of second tasksis narrowed, there is a case that the number to be suggested is toolarge. Consequently, the second task extracting unit 63 narrows down thenumber of second tasks to be suggested in consideration of aninterruption risk, tastes of the driver, and the like.

The interruption risk is grasped by using the interruption risk graspingfunction. The second task extracting unit 63 calculates an interruptionrisk in consideration of at least one of the traffic information and theweather information. The interruption risk is a risk that the time zones(hereinafter, predicted time zones) TZ1 and TZ2 which are predicted ofthe task possible time cannot be set as initially predicted and thepredicted time zones TZ1 and TZ2 are interrupted at the time of actualtravel. For example, when it is snowing, an unexpected traffic accidenttends to occur, so that the automation driving level is lowered fromLevel 3 to Level 2 or lower to prevent the traffic accident and, sincethe possibility that the second task cannot be executed increases, theinterruption risk becomes higher. For example, in the chase where alarge-scale event is held around the path and the traffic amountprediction precision decreases, there is the possibility that trafficjam is solved unexpectedly, travel time at speed less than permissiblespeed becomes short and, as a result, a second task cannot be executed.

The higher the interruption risk is, the more the second task extractingunit 63 has the tendency of preferentially extracting a second taskwhich is less influenced by an interruption. A second task which is lessinfluenced by an interruption can be grasped, for example, by using theinterruption handling characteristic stored in the second task DB. Asecond task which is less influenced by an interruption corresponds to,for example, when a second task is watching of content, watching ofcontent such as a variety program, a sports program recorded, and thelike.

The second task extracting unit 63 of the embodiment processes suchextraction for each of the predicted time zones TZ1 and TZ2. Therefore,in the case where the task possible time is divided into a plurality oftime zones TZ1 and TZ2, the extracting process is executed for each ofthe divided time zones TZ1 and TZ2. Information of one or plural secondtasks extracted for each of the time zones TZ1 and TZ2 is provided tothe information presentation generating unit 64. The informationpresentation generating unit 64 generates information presentationcontent which is presented to the information presentation device 31.

The information presentation generating unit 64 controls display by thedisplay 32 and controls sound made by the speaker 33. The informationpresentation generating unit 64 allocates the information presentationcontent to the elements of the display 32 and the speaker 33.Simultaneously, the information presentation generating unit 64generates video data sequentially displayed in the display 32 and drawseach of frame images constructing the video data. The informationpresentation generating unit 64 generates sound data to let the speaker33 make sound in collaboration with the video data. The informationpresentation generating unit 64 has a route plan suggesting function anda second task suggesting function.

The route plan suggesting function is a function of suggesting aplurality of route plans generated by the autonomous driving ECU 51 andgrasped by the route grasping unit 62 to the driver so that one of theplurality of route plans is determined by selection of the driver. Theinformation presentation generating unit 64 generates, as display items(also called display content) which are displayed in the display 32, asillustrated in FIG. 4, a plan suggestion display item D1A and a mapdisplay item D1B.

In the plan suggestion display item D1A, a plurality of route plansgrasped by the route grasping unit 62 are displayed as a list. In theplan suggestion display item D1A, the title of each route plan, thedistance (way) of paths in each route plan, predicted autonomous drivingtime, and departure time and predicted arrival time are displayed in atable. The map display item D1B is a display item accompanying the plansuggestion display item D1A and displays a path on a map correspondingto a route plan. The video data including the plan suggestion displayitem D1A and the map display item D1B generated is output as an electricsignal to the display 32 and displayed in the allocated screen 32 a.

The second task suggesting function is a function of suggesting a secondtask extracted by the second task for the route plan determined by theselection of the driver. The information presentation generating unit 64generates, as a display item to be displayed in the display 32, a taskpossible time display item D2A and a second task suggestion display itemD2B as illustrated in FIG. 5.

In the task possible time display item D2A, task possible time during aroute is displayed. The task possible time display item D2A includes aroute arrow image IM1 and a task possible time display image IM2. Theroute arrow image IM1 is an image schematically depicting the route, inwhich one or plural predicted time zones TZ1 and TZ2 corresponding tothe task possible time and a time zone which does not correspond to thetask possible time are displayed so as to be distinguished from eachother. The distinction is made by, for example, modes of differentcolors but another mode such as different thicknesses of lines or aplurality of modes may be combined. The task possible time display imageIM2 displays the task possible time which is quantified as time fromstart to end of each of the predicted time zones TZ1 and TZ2 for each ofthe predicted time zones TZ1 and TZ2.

The second task presentation display item D2B is a display itemaccompanying the task possible time display item D2A and displays asecond task to be suggested. The second task suggestion display item D2Bdisplays a list of overviews of a plurality of second tasks to besuggested for each of the predicted time zones TZ1 and TZ2 which aredepicted in the task possible time display item D2A. For example, thesecond task to be suggested is watching of content reproduced by theinformation presentation device 31, the overview of the content isformed by an illustration or video image symbolizing the content andtext display of the title of the content. The video data including thetask possible time display item D2A and the second task presentationdisplay item D2B generated is output as an electric signal to thedisplay 32 and displayed in the allocated screen 32 a.

The suggestion process by the information presentation generating unit64 is executed, typically, before departure of the route to thedestination. The information presentation generating unit 64 displaysthe video data regarding the above-described suggested in the display 32and waits, while maintaining the suggestion screen, until an input ofthe user operation of the driver to the suggestion is recognized.

The operation information acquiring unit 65 acquires information of theuser operation (for example, operation of touching the second tasksuggestion display item D2B) of the driver for the above-describedsuggestion from the operation device 21 (for example, a touch panel).The information of the user operation acquired is provided to thecontent control unit 66 and the like.

The content control unit 66 controls reproduction of content to bewatched in the second task. The content control unit 66 has a contentsetting function and a content reproducing function.

The content setting function is a function of accepting setting ofcontent to the suggestion of the second task by the informationpresentation generating unit 64 and setting reproduction of the content.When the information of a user operation of setting content to bewatched by the driver is grasped by the operation information acquiringunit 65, the content control unit 66 executes a process of setting thecontent. Concretely, as illustrated in FIG. 3, the content control unit66 makes the setting so that the content is reproduced in the predictedtime zones TZ1 and TZ2 corresponding to the set content.

The content reproducing function is a function of reproducing thecontent during the route to the destination by using the display 32 andthe speaker 33 in accordance with the reproduction setting. The contentcontrol unit 66 sequentially determines whether a second task can beexecuted or not during the route to the destination and reproduces theset content in the time zone TZ in which a second task can be executed.

Specifically, when occurrence of the time zone TZ in which a second taskcorresponding to the predicted time zones TZ1 and TZ2 can be executed isdetermined, the content control unit 66 starts reproduction of the setcontent. Naturally, it can happen the start timing of the time zone TZin which a second task can be executed varies slightly at the time ofactual travel of the vehicle with respect to the start timing uponprediction of the predicted time zones TZ1 and TZ2. Consequently, whenthe start timing of the time zone TZ in which a second task can beexecuted is within a predetermined error time with respect to the starttiming upon prediction, the content control unit 66 determines that thetime zone TZ in which a second task can be executed is the predictedtime zones TZ1 and TZ2.

As described above, the content control unit 66 obtains a change in thetask possible time recalculated by the second task extracting unit 63and the time zone TZ in which a second task can be executed during theroute to the destination. For example, traffic jam may occurunexpectedly in a section before the section corresponding to thepredicted time zones TZ1 and TZ2 during the route to the destination.There is consequently a case that a time zone (hereinbelow, unexpectedtime zone) TZ3 that is the time zone TZ in which a second task can beexecuted and is separated from the predicted time zones TZ1 and TZ2additionally occurs before the predicted time zones TZ1 and TZ2. Whenthe unexpected time zone TZ3 occurs before the predicted time zones TZ1and TZ2 in the route to the destination, the content control unit 66starts reproducing the content set for the predicted time zone TZ1immediately after the unexpected time zone TZ3 by advancing the timingto the unexpected time zone TZ3.

As another example, there is a case that traffic jam occurs unexpectedlyin a section after the sections corresponding to the predicted timezones TZ1 and TZ2 during the route to the destination. There isconsequently a case that an unexpected time zone TZ4 that is a time zonein which a second task can be executed and is separated from thepredicted time zones TZ1 and TZ2 occurs additionally before thepredicted time zones TZ1 and TZ2. When the unexpected time zone TZ4occurs after the predicted time zone TZ2 in the route to thedestination, the second task extracting unit 63 extracts an additionalsecond task which can be executed properly within the time of theunexpected time zone TZ4. At the time point when occurrence of theunexpected time zone TZ4 is predicted, the additional second task isalso suggested to the driver and the driver's intention is confirmedthrough the user interface 20 in a manner similar to that before thedeparture.

Next, a method of assisting execution of a second task on the basis of asecond task execution assistance program stored in the storing unit 13and executed by the processing unit 11 will be described with referenceto the flowcharts of FIGS. 6 and 7. Referring to FIG. 6, a method ofsuggesting a second task and confirming the intention of the driverbefore departure to a destination will be mainly described. Referring toFIG. 7, a method of handling a situation change during a route to adestination after departure will be mainly described.

A series of processes based on the steps of the flowchart of FIG. 6 isexecuted after an occupant such as a driver sets a destination by usingthe non-driving-operation device 23.

In S101, the route grasping unit 62 grasps a route to be suggested byobtaining information of a plurality of routes generated by theautonomous driving ECU 51. After the process of S101, the program movesto S102.

In S102, the information presentation generating unit 64 obtainsinformation of a plurality of route plans from the route grasping unit62 and generates video data to suggest a plurality of routes to thedriver on the basis of the information of the plurality of route plans.The generated video data is displayed in the screen 32 a of the display32 (refer to also FIG. 4), and a state of waiting for a user operationof the driver is set. After the process of S102, the program moves toS103.

In S103, the operation information acquiring unit 65 determines whetheran intention of selecting one route plan from the plurality of routeplans is indicated by the user operation of the driver or not. When thepositive determination is made in S103, the program moves to S104. Whenthe negative determination is made in S103, the state of waiting for auser operation of the driver is continued and, after predetermined time,the determination of S103 is executed again.

In S104, the second task extracting unit 63 calculates task possibletime in a selected route plan, and extracts a second task to besuggested on the basis of the task possible time. After the process ofS104, the program moves to S105.

In S105, the information presentation generating unit 64 generates videodata for suggesting a second task on the basis of information of thesecond task to be suggested obtained from the second task extractingunit 63. The generated video data is displayed in the screen 32 a of thedisplay 32 (also refer to FIG. 5) and the state of waiting for a useroperation of the driver is obtained. After the process of S105, theprogram moves to S106.

In S106, when the second task suggested by the user operation of thedriver is watching of content, the operation information acquiring unit65 determines whether intention to set watching of specific content tobe watched is indicated or not. When the positive determination is madein S106, the program moves to S107. When the negative determination ismade in S106, the program moves to S108.

In S107, the content control unit 66 sets content and starts controllingreproduction of the set content. After S107, the series of processes isfinished.

In S108, the content control unit 66 regards that the driver executes asecond task other than watching of the content or does not execute asecond task itself and determines that reproduction of the content isnot executed. After S108, the series of processes is finished.

The series of processes based on the steps of the flowchart of FIG. 7 isexecuted when a change in the traffic situation or a change in theweather situation occurs during a route to a destination afterdeparture.

In S111, the second task extracting unit 63 recalculates the taskpossible time and the time zone TZ including the task possible time inaccordance with a change in the traffic situation or a change in theweather situation. After the process of S111, the program moves to S112.

In S112, the content control unit 66 determines whether or not theunexpected time zones TZ3 and TZ4 occur in recalculation of the secondtask extracting unit 63. When positive determination is made in S112,the program moves to S113.

In S113, the content control unit 66 determines whether or not theunexpected time zones TZ3 and TZ4 are earlier than the predicted timezone TZ1 or TZ2 which is predicted before the departure. When positivedetermination is made in S113, the program moves to S114. When negativedetermination is made in S113, the program moves to S115. When aplurality of unexpected time zones TZ3 and TZ4 occur like in FIG. 3, aprocess after handling each of the unexpected time zone TZ3 is executedand then a process after handling TZ4 can be executed.

In S114, the content control unit 66 starts reproducing content set forthe predicted time zone TZ1 immediately after the unexpected time zoneTZ3 so as to be advanced to the unexpected time zone TZ3. After S114,the series of processes is finished.

In S115, since the unexpected time zone TZ4 is later than the predictedtime zones TZ1 and TZ2, the second task extracting unit 63 extracts anadditional second task which can be executed properly within the time ofthe unexpected time zone TZ4, and the information presentationgenerating unit 64 suggests the additional content by using theinformation presentation device 31. After S115, the series of processesis finished.

In S116, since the unexpected time zones TZ3 and TZ4 do not occur, thecontent control unit 66 determines to reproduce the content which is setfor the predicted time zones TZ1 and TZ2, in the predicted time zonesTZ1 and TZ2. After S116, the series of processes is finished.

In the first embodiment, the HCU 100 corresponds to a “second taskexecution assistance device” assisting execution of a second task of adriver in an autonomous driving state in which the vehicle 1 becomes anexecution entity of a driving task in cooperation with the userinterface 20. The information presentation generating unit 64corresponds to a “second task presenting unit” suggesting a second taskthrough the user interface 20.

Effects

The effects of the first embodiment described above will be explainedagain hereinafter.

According to the first embodiment, a second task suggested to a driverthrough the user interface 20 is a second task which can be properlyexecuted within predicted task possible time as time in which a secondtask can be executed. Since a second task appropriate to task possibletime is suggested, even when it is difficult for a driverhimself/herself to accurately understand and predict a condition underwhich a second task can be executed and task possible time correspondingto the condition, the driver can easily select a proper second task. Byselecting and executing a second task optimized in time, the driver caneffectively use time in a route to a destination.

According to the first embodiment, in the case where the task possibletime is divided into a plurality of short time zones TZ1 and TZ2, adifferent second task is suggested to each of the short time zones. Itsuppresses that the driver executes one second task in the plurality oftime zones TZ1 and TZ2. Therefore, the driver can execute a second taskat an appropriate timing, and troublesomeness and frustration given tothe driver can be reduced.

According to the first embodiment, a second task of task required timehaving a difference less than a predetermined error time with respect totask possible time is retrieved, and at least a part of the retrievedsecond task is extracted as a second task to be suggested. In retrieval,the second task DB 61 in which various second tasks and their taskrequired times are associated is used. Since the required time of asecond task can be easily obtained by accessing to the DB 61, theresources of a computer can be effectively used and a more appropriatesecond task can be suggested.

According to the first embodiment, the higher an interruption risk thatthe autonomous driving state is interrupted is, the more a second taskwhich is less influenced by an interruption is extracted. When thedriver executes a second task which is less influenced by interruptionin response to the suggestion, even if the autonomous driving state isinterrupted unexpectedly, troublesomeness and frustration given to thedriver can be reduced.

According to the first embodiment, reproduction of content to be watchedin a second task of watching content is controlled according to the taskpossible time. When reproduction of content is controlled according totask possible time, an operation of the driver such as setting ofreproduction start time of suggested content in accordance with a timezone of task possible time can be eliminated. Therefore, the driver caneasily execute a second task.

According to the first embodiment, when the driver sets suggestedcontent, the set content is reproduced in a time zone in which executionof a second task becomes actually possible. Since set content isreproduced in accordance with actual time, even if actual time becomesdifferent from time at the time of prediction, occurrence of a situationthat content is reproduced in a manual driving state or a state wherethe driver has to monitor the surrounding can be suppressed.

According to the first embodiment, in the case where, after content isset, the unexpected time zone TZ3 as another time zone in which a secondtask can be executed occurs unexpectedly before the predicted time zonesTZ1 and TZ2 as time zones predicted at the time of setting, reproductionof the set content is started in the unexpected time zone TZ3 earlierthan scheduled. Since content the driver desires to watch can beprovided early, satisfaction at the time of execution of a second taskof the driver can be increased.

According to the first embodiment, task possible time is predicted inconsideration of at least one of traffic information of a road on whichthe vehicle 1 travels and weather information. By making a dynamicfactor which changes task possible time such as traffic information andweather information included in prediction, precision of predicting taskpossible time increases. Further, the possibility that required time ofa second task suggested is within task possible time and the possibilitythat occurrence of margin in task possible time can be decreased. Withthe above, the driver can effectively use time in a route to adestination.

Second Embodiment

As illustrated in FIGS. 8 and 9, a second embodiment is a modificationof the first embodiment. The second embodiment will be described mainlywith respect to the point different from the first embodiment.

The second task extracting unit 63 of the second embodiment obtainsinformation of a plurality of route plans which are generated by theautonomous driving ECU 51 and are before narrowed down to one throughthe route grasping unit 62 and extracts a second task which can beproperly executed for each of the route plans. Specifically, the secondtask extracting unit 63 calculates task possible time for each routeplan and extracts a second task which can be executed properly withintask possible time individually corresponding to each of the route plan.

The information presentation generating unit 64 of the second embodimenthas a lump suggestion function. The lump suggestion function is afunction of suggesting a route plan and a second task in a lump to makethe driver select one optimum route plan from a plurality of route plansin consideration of a second task which can be executed properly. Theinformation presentation generating unit 64 generates a lump suggestiondisplay item D3 as a display item displayed in the display 32.

In the lump suggestion display item D3, a plurality of route plans aredisplayed in a list. In the lump presentation display item D3, a titleof each route plan, predicted driving time for each route plan,predicted manual driving time for each route plan, predicted time whenthe level becomes Level 2 in the automatic driving time corresponding tothe route plan, task possible time corresponding to each of the routeplans, and a second task which can be executed properly within the taskpossible time corresponding to the route plan are displayed in a table.In FIG. 8, the predicted driving time is displayed as “required time”,the predicted manual driving time is displayed as “manual time”, theprediction time of Level 2 is displayed as “Level-2 time”, and the taskpossible time is displayed as “Level-3 time”. Video data including thegenerated lump suggestion display item D3 is output as an electricsignal to the display 32 and displayed in the allocated screen 32 a.

In the second embodiment, also in the case where the task possible timeis divided into a plurality of short time zones, the second taskextracting unit 63 extracts a second task which can be properly executedwithin total task possible time of the time zones. The informationpresentation generating unit 64 also suggests total task possible timeand a second task appropriate to the time.

Next, a method of assisting execution of a second task on the basis of asecond task execution assistance program stored in the storing unit 13and executed by the processing unit 11 will be described with referenceto the flowchart of FIG. 9. Referring to FIG. 9, a method of suggestinga second task and confirming intention of the driver before departure toa destination will be mainly described.

S201 is similar to S101 of the first embodiment. After the process ofS201, the program moves to S202.

In S202, the second task extracting unit 63 calculates task possibletime in a plurality of route plans and extracts a second task to besuggested for each route plan on the basis of the task possible time.After the process of S202, the program moves to S203.

In S203, the information presentation generating unit 64 generates videodata suggesting a plurality of route plans and second taskscorresponding to the route plans in a lump on the basis of informationof the plurality of route plans obtained from the route grasping unit 62and information of the second tasks to be suggested obtained from thesecond task extracting unit 63. After the process of S203, the programmoves to S204.

S204 to S206 are similar to S106 to S108 of the first embodiment. AfterS205 or S206, the series of processes is finished.

According to the second embodiment described above, a plurality ofroutes to a destination, task possible time in each of the routes, and asecond task which can be properly executed within the task possible timein each route are suggested in a lump. By such a lump suggestion, thedriver can select one route from the plurality of routes in accordancewith a second task the driver desires to execute. Therefore, a routeselecting method which is novel and has not been available of selectinga route placing priority of a second task can be provided.

Third Embodiment

As illustrated in FIGS. 10 and 11, a third embodiment is a modificationof the first embodiment. The third embodiment will be described mainlywith respect to the point different from the first embodiment.

In a manner similar to the first embodiment, the content control unit 66of the third embodiment obtains task possible time recalculated by thesecond task extracting unit 63 and a change of the time zone TZ in whicha second task can be executed during a route to a destination. Asillustrated in FIG. 10, when the unexpected time zone TZ3 occurs beforethe predicted time zone TZ1, the content control unit 66 determineswhether or not content set for the predicted time zone TZ1 is reproducedso as to be advanced to the unexpected time zone TZ3 in accordance withthe length of the unexpected time zone TZ3.

Specifically, the content control unit 66 determines whether or not thelength of the unexpected time zone TZ3 is long time which is equal to orlonger than the predicted time zone TZ1. In the case where the length ofthe unexpected time zone TZ3 is long time equal to or longer than thepredicted time zone TZ1, the content control unit 66 starts reproducingthe content set for the predicted time zone TZ1 so as to be advanced tothe unexpected time zone TZ3.

In the case where the length of the unexpected time zone TZ3 is shorttime less than the predicted time zone TZ1, the content control unit 66reproduces the content set for the predicted time zone TZ1 as planned inthe predicted time zone TZ1. For the unexpected time zone TZ3, thesecond task extracting unit 63 extracts an additional second task whichcan be properly executed within the time of the unexpected time zoneTZ3. Also with respect to the additional second task, at the time pointoccurrence of the unexpected time zone TZ3 is predicted, suggestion andintention confirmation to the driver is performed through the userinterface 20 in a manner similar to that before departure.

Next, a method of assisting execution of a second task on the basis of asecond task execution assistance program stored in the storing unit 13and executed by the processing unit 11 will be described by using theflowchart of FIG. 11. Referring to FIG. 11, a method of dealing with asituation change during a route to a destination after departure will bemainly described.

S311 to S313 are similar to S111 to S113 of the first embodiment. Whennegative determination is made in S312, the program moves to S317. Whenpositive determination is made in S313, the program moves to S314. Whennegative determination is made in S313, the program moves to S314.

In S314, the content control unit 66 determines whether the length ofthe unexpected time zones TZ3 and TZ4 is long time equal to or longerthan the predicted time zone. When positive determination is made inS314, the program moves to S315. When negative determination is made inS316, the program moves to S316.

In S315, the content control unit 66 starts reproducing content set forthe predicted time zone TZ1 so as to be advanced to the unexpected timezone TZ3. After S315, the series of processes is finished.

In S316, the unexpected time zones TZ3 and TZ4 are after the predictedtime zone TZ1 or the unexpected time zone TZ3 is short time.Consequently, the second task extracting unit 63 extracts an additionalsecond task which can be properly executing with the time of theunexpected time zones TZ3 and TZ4 and the information presentationgenerating unit 64 suggests the additional content by using theinformation presentation device 31. After S316, the series of processesis finished.

In S317, since the unexpected time zone TZ3 does not occur, the contentcontrol unit 66 determines to reproduce content set for the predictedtime zone TZ1, in the predicted time zone TZ1. After S317, the series ofprocesses is finished.

According to the third embodiment described above, in the case where theunexpected time zone TZ3 in which a second task becomes executableunexpectedly occurs after content is set and before the predicted timezone TZ1 which is predicted at the time of setting, whether reproductionof the set content is started so as to be advanced to the unexpectedtime zone TZ3 is determined. Since whether reproduction of one piece ofcontent is divided into a plurality of time zones in the case ofadvancing the reproduction can be determined on the basis of the lengthof the unexpected time zone TZ3, flexible reproduction control accordingto whether content can be divided or not can be performed.

According to the third embodiment, in the case where the unexpected timezone TZ3 occurs before the predicted time zone TZ1 and the unexpectedtime zone TZ3 is long time equal to or longer than the predicted timezone TZ1, reproduction of the set content is started so as to beadvanced to the unexpected time zone TZ3. Since content the driverwishes to watch can be provided early while suppressing division ofreproduction of the content to a plurality of time zones, satisfactionlevel of the driver at the time of execution of a second task can bemade higher.

According to the third embodiment, in the case where the unexpected timezone TZ3 occurs before the predicted time zone TZ1 and the unexpectedtime zone TZ3 is short time less than the predicted time zone TZ1, asecond task which can be properly executed within time of the unexpectedtime zone TZ3 different from the set content is suggested. By selectingand executing the suggested second task, the driver can effectively usealso a time zone which occurs unexpectedly.

Other Embodiments

Although a plurality of embodiments have been described above, thepresent disclosure is not interpreted by being limited to theembodiments but can be applied to various embodiments and combinationswithout departing from the gist of the present disclosure.

Concretely, as a first modification of the first embodiment, the secondtask extracting unit 63 may extract a second task which can be properlyexecuted for each of route plans before one route plan is determinedlike in the second embodiment. The information presentation generatingunit 64 may display the suggestion screen of FIG. 4 and, when a useroperation of selecting one route plan by the driver is recognized,suggest a second task extracted in advance in accordance with theselected route plan by the suggestion screen of FIG. 5.

As a second modification of the second embodiment, in the lumpsuggestion display item D3, as long as the title of each route plan,task possible time appropriate to each route plan, and a second taskwhich can be properly executed within the task possible time appropriateto each route plan are displayed, other time and the like may not bedisplayed.

As a third modification of the third embodiment, the content controlunit 66 may determine whether or not length of the unexpected time zoneTZ3 is long time equal to or longer than task required time of a secondtask to be determined to be advanced or not in place of determiningwhether or not length of the unexpected time zone TZ3 is long time equalto or longer than the predicted time zone TZ1.

As a fourth modification, in the range where the gist of suggestion ismaintained, display layouts and the like of the suggestion screens ofFIGS. 3, 5, and 8 can be properly changed. For example, in thesuggestion screens of FIGS. 3 and 8, in place of displaying a pluralityof route plans in a table, the route plans can be displayed so as to bearranged like icons.

As a fifth modification, the autonomous driving ECU 51 may have aspecification that when the vehicle 1 travels in an autonomous drivingsection, the autonomous driving state managing unit 52 sets theautonomous driving level to Level 3 regardless of the speed of thevehicle 1 as long as an unexpected factor such as reach to the functionlimit of the autonomous driving function does not occur.

As a sixth modification, even when the autonomous driving level is Level3, if an additional condition is not satisfied, the driver cannotexecute a second task, that is, the task possible time is not added. Theadditional condition is, for example, a situation that the possibilityof changing to the driving to the driver is lower than a predeterminedvalue.

As a seventh modification, task possible time is calculated in theautonomous driving ECU 51, and the second task extracting unit 63 of theHCU 100 may extract a second task to be suggested by using the taskpossible time obtained from the autonomous driving ECU 51.

As an eighth modification, each of the functions provided by the HCU 100and the autonomous driving ECU 51 can be provided by software andhardware executing it, only software, only hardware, or compositecombination of them. Further, in the case where such a function isprovided by an electronic circuit as hardware, each function can beprovided by a digital circuit including a number of logic circuits or ananalog circuit.

As a ninth modification, the form of a storing medium storing a programor the like capable of realizing the above-described informationpresentation control may be also properly changed. For example, astorage medium is not limited to a configuration provided on a circuitboard but may be provided in the form of a memory card or the like whichis inserted in a slot and electrically connected to the control circuitof the HCU 100 or the autonomous driving ECU 51. Further, the storagemedium may be an optical disk, a hard disk, or the like from which aprogram is copied to the HCU 100 or the autonomous driving ECU 51.

As a tenth modification, at least a part of the functions (for example,a function of planning a schematic route) in the route planning unit 53of the autonomous driving ECU 51 may be realized by the HCU 100. Theautonomous driving ECU 51 and the HCU 100 may be integrated in oneelectronic control unit and the electronic control unit may correspondto the “second task execution assistance device”.

As an eleventh modification, the HCU 100 may not have the contentcontrol unit 66. An audio device communicably connected to the HCU 100,different from the HCU 100, may be provided, and the audio device mayrealize the function of the content control unit 66.

As a twelfth modification, the second task execution assistance devicemay not be mounted in the vehicle 1. For example, when the second taskexecution assistance device is the HCU 100, in the case where the HCU100 is not mounted in the vehicle 1 but is disposed fixedly on theoutside of the vehicle or is mounted in another vehicle, the informationpresentation device 31 may be remote-controlled by communication of theinternet, road-to-vehicle communication, vehicle-to-vehiclecommunication, or the like.

The second task execution assistance device may be a control device of aportable terminal such as a smartphone. As the portable terminal, thecontrol device and a user interface such as a display may be integrallyformed. At least one of suggestion of a route plan and suggestion of asecond task by the portable terminal does not have to be executed in thevehicle 1 but may be made by the driver before riding on the vehicle 1,for example, at home or a place where the driver dropped in such as aservice area of an expressway.

As a thirteenth modification, the vehicle 1 can perform the autonomousdriving of Level 4 in the automation driving levels defined by thesociety of automotive engineers of the United States. In this case,since autonomous driving possible sections and other sections can exist,it is effective to set predicted autonomous driving time predicted to berequired to travel the autonomous driving section as task possible timeand suggest a second task which can be properly executed in the taskpossible time.

As a fourteenth modification, the vehicle 1 is not limited to a generalprivate car but may be a rental car, a vehicle for a manned taxi, aride-share vehicle, a freight vehicle, a bus or the like.

As a fifteenth modification, by coupling the driving operation device 22directly to the vehicle control actuator 44, in the case such that theautomation driving level is Level 0, the driver may directly operate thevehicle control actuator 44 without using the autonomous driving ECU 51.

As a sixteenth modification, the vehicle 1 may be optimized according tothe road traffic law of each country and area. Further, task possibletime grasped by the second task execution assistance device and a secondtask extracted and suggested by the second task execution assistancedevice may be optimized according to the road traffic law of eachcountry and area.

The control unit and its method described in the present disclosure maybe realized by a dedicated computer constructing a processor programmedso as to execute one or plural functions embodied by a computer program.Alternately, the device and its method described in the presentdisclosure may be realized by a dedicated hardware logic circuit.Alternately, the device and its method described in the presentdisclosure may be realized by one or more dedicated computers configuredby combination of a processor executing a computer program and one ormore hardware logic circuits. The computer program may be stored as aninstruction executed by a computer in a computer-readable non-transitiontangible recording medium.

Although the present disclosure is described in accordance with theembodiments, it is to be understood that the present disclosure is notlimited to the embodiments and structures. The present disclosureincludes various modifications and also modifications in range ofequivalency. In addition, although various combinations and modes aredescribed in the present disclosure, other combinations and modesincluding only one element or more or less are within the range of thepresent disclosure and the idea range.

The controllers and methods described in the present disclosure may beimplemented by a special purpose computer created by configuring amemory and a processor programmed to execute one or more particularfunctions embodied in computer programs. Alternatively, the controllersand methods described in the present disclosure may be implemented by aspecial purpose computer created by configuring a processor provided byone or more special purpose hardware logic circuits. Alternatively, thecontrollers and methods described in the present disclosure may beimplemented by one or more special purpose computers created byconfiguring a combination of a memory and a processor programmed toexecute one or more particular functions and a processor provided by oneor more hardware logic circuits. The computer programs may be stored, asinstructions being executed by a computer, in a tangible non-transitorycomputer-readable medium.

It is noted that a flowchart or the processing of the flowchart in thepresent application includes sections (also referred to as steps), eachof which is represented, for instance, as S101. Further, each sectioncan be divided into several sub-sections while several sections can becombined into a single section. Furthermore, each of thus configuredsections can be also referred to as a device, module, or means.

While the present disclosure has been described with reference toembodiments thereof, it is to be understood that the disclosure is notlimited to the embodiments and constructions. The present disclosure isintended to cover various modification and equivalent arrangements. Inaddition, while the various combinations and configurations, othercombinations and configurations, including more, less or only a singleelement, are also within the spirit and scope of the present disclosure.

What is claimed is:
 1. A second task execution assistance device assisting execution of a second task of a driver in cooperation with a user interface in an autonomous driving state in which a vehicle is an execution entity of a driving task, the second task execution assistance device comprising: a second task extracting unit grasping task possible time estimated as time in which the second task is executable in a route to a destination of the vehicle, and extracting the second task having a task required time shorter than the task possible time and equal to or longer than a predetermined ratio of the task possible time from a second task database; and a second task suggesting unit suggesting the second task extracted by the second task extracting unit through the user interface.
 2. The second task execution assistance device according to claim 1, wherein: the second task suggesting unit suggests the second task for each of a plurality of short time zones when the task possible time is divided into the plurality of short time zones.
 3. The second task execution assistance device according to claim 1, herein the second task extracting unit accesses the second task database in which various second tasks are respectively connected to task required times as required times for the second tasks, retrieves a part of the various second tasks having the task required times with a difference less than a predetermined error time from the task possible time, and extracts at least a part of retrieved second tasks.
 4. The second task execution assistance device according to claim 1, wherein: the second task extracting unit calculates an interruption risk that the autonomous driving state is interrupted, using at least one of traffic information of a road on which the vehicle travels and weather information; and the second task extracting unit has a tendency to extract the second task with an influence of an interruption which is small as the interruption risk becomes high.
 5. The second task execution assistance device according to claim 1, further comprising: a content control unit controlling reproduction of a content as a watching target in the second task for watching the content in accordance with the task possible time.
 6. The second task execution assistance device according to claim 5, wherein: the content control unit grasps a user operation for reserving the content suggested by the second task suggesting unit; and the content control unit reproduces a reserved content in a time zone the second task becomes actually executable.
 7. The second task execution assistance device according to claim 6, wherein: when an unexpected time zone occurs as another time zone, in which the second task becomes executable unexpectedly, earlier than a predicted time zone as a time zone predicted at a time of a reservation after reserving the content, the content control unit starts reproducing the reserved content so as to be advanced to the unexpected time zone.
 8. The second task execution assistance device according to claim 6, wherein: when an unexpected time zone occurs as another time zone, in which the second task becomes executable unexpectedly, earlier than a predicted time zone as the time zone predicted at a time of a reservation after reserving the content, the content control unit determines in accordance with a length of the unexpected time zone whether reproduction of the reserved content is started so as to be advanced to the unexpected time zone.
 9. The second task execution assistance device according to claim 8, wherein: when the unexpected time zone occurs earlier than the predicted time zone and the length of the unexpected time zone is equal to or longer than the predicted time zone, the content control unit starts reproducing the reserved content so as to be advanced to the unexpected time zone.
 10. The second task execution assistance device according to claim 8, wherein: when the unexpected time zone occurs earlier than the predicted time zone and the length of the unexpected time zone is shorter than the predicted time zone, the content control unit suggests the second task which is executable properly within the unexpected time zone and different from the reserved content.
 11. The second task execution assistance device according to claim 1, wherein: the second task extracting unit grasps a plurality of routes to the destination and extracts the second task which is executable properly for each of the routes; and the second task suggesting unit suggests each of the routes, the task possible time in each of the routes, and the second task which is executable properly within the task possible time in each of the routes, thereby suggesting the second task and requesting the driver to select one of the routes.
 12. The second task execution assistance device according to claim 1, wherein: the second task extracting unit predicts the task possible time in consideration of at least one of traffic information of a road on which the vehicle travels and weather information.
 13. The second task execution assistance device according to claim 1 further comprising: one or more processors; and a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to provide at least: the second task extracting unit and the second task suggesting unit.
 14. A non-transitory tangible computer readable storage medium comprising instructions being executed by a computer, the instructions including a computer-implemented method for assisting an execution of a second task of a driver in cooperation with a user interface in an autonomous driving state in which a vehicle is an execution entity of a driving task, the instructions causing at least one processor to execute: grasping task possible time estimated as time in which the second task is executable in a route to a destination of the vehicle; extracting the second task having a task required time shorter than the task possible time and equal to or longer than a predetermined ratio of the task possible time from a second task database; and suggesting an extracted second task via the user interface. 